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THE MAXIMUM-LIKELIHOOD DECODING 
THRESHOLD FOR CYCLE CODES OF GRAPHS 


PETER NELSON AND STEFAN H.M. VAN ZWAM 

Abstract. For a class C of binary linear codes, we write 
6c : (0,1) [0, | for the maximum-likelihood decoding threshold 

function of C, the function whose value at R £ (0,1) is the largest 
bit-error rate p that codes in C can tolerate with a negligible prob¬ 
ability of maximum-likelihood decoding error across a binary sym¬ 
metric channel. We show that, if C is the class of cycle codes of 
graphs, then 9c{R ) < 2 (i+R) f° r eac ^ and show that equality 
holds only when R is asymptotically achieved by the cycle codes 
of regular graphs. 


1. Introduction 

For a class C of binary linear codes and for some rate R G (0,1), we 
consider the maximum-likelihood decoding threshold 9c(R) for C at R. 
This is the unique 6 G [0, |] such that 

• for each p G (0, 6) and all e > 0, given a binary symmetric 
channel of bit-error rate p, there exists a code C G C of rate 
at least R such that the probability of a error in maximum- 
likelihood decoding on C is at most e, and 

• for each p G ( 9 , |) there exists £ > 0 such that, given a binary 
symmetric channel of bit-error rate p, for each code C G C 
of rate at least R the probability of an error in maximum- 
likelihood decoding on C is at least e. 

The function 9c(R) is the threshold function for C; it essentially mea¬ 
sures the maximum bit-error rate that can be ‘tolerated’ by rate-I? 
codes in C with vanishing probability of a decoding error. Our main 
result proves an upper bound on this function for the class Q of cycle 
codes of graphs: 

Theorem 1.1. If Q is the class of cycle codes of graphs and R G (0,1), 
then 9g(R) < ^(l+lj • If equality holds, then R = 1 — | for some d G Z. 

This research was partially supported by a grant from the Office of Naval Re¬ 
search [N00014-12-1-0031] and by grants from the National Science Foundation 
Division of Mathematical Sciences [1501985, 1500343]. 
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This generalises a result of Decreusefond and Zemor [4] , who proved 
the same upper bound for the class of cycle codes of regular graphs. Our 
proof follows theirs conceptually, although our exposition and notation 
are somewhat different. The proof in [4] implicitly involves a problem of 
enumerating ‘non-backtracking’ walks that is trivial for regular graphs 
but not in general; much of the original material in our proof is related 
to this difficulty. 

When R = 1 — ^ for some d G Z (that is, when the cycle codes of large 
d-regular graphs have rate close to R) our theorem does not improve 
the bound 9g(R) < • I 11 this case, however, the bound is known 

to be best-possible; Zemor and Tillich [T3] showed, when cZ — 1 is one 
of various prime powers, that certain families of d-regular Ramanujan 
graphs have cycle codes attaining this threshold (that is, can tolerate a 
bit-error rate of p for any p < ), an d later random constructions 

due to Alon and Bachmat [I] can be demonstrated to give the same 
result for all d > 3. Combining these constructions with Theorem 11.11 
we have the following: 

Theorem 1.2. If Q is the class of cycle codes of graphs, and R— 1 —§ 
for some integer d> 3, then 9g{R) = ^(l+lj • 

Theorem 11.11 implies that this equality holds for no other R G (0,1); 
this can be interpreted as a statement that the cycle codes of regular 
graphs are ‘best’ among all cycle codes. 

Theorem 11.11 will be derived as a consequence of a stronger upper 
bound for 9g, given in Theorem 13.41 While the bound in Theorem 13.41 
is highly technical in its statement, we believe (Conjecture 13.5ft that it 
is in fact the correct upper bound. 

Minor-Closed Classes. The main result of jTT] shows that the failure 
of the cycle codes to be ‘asymptotically good’ extends to every proper 
minor-closed subclass of binary codes; that is, every proper subclass 
that is closed under puncturing and shortening. The proof uses a deep 
result in matroid structure theory due to Geelen, Gerards and Whittle 
[0] that states, roughly, that the ‘highly connected’ members of any 
such class of codes are close to being either cycle codes or their duals. 

We believe that this paradigm that the members of any minor-closed 
subclass of binary codes are ‘nearly’ cycle or cocycle codes will also 
apply to the threshold function. We predict that the threshold function 
9g(R) for any minor-closed class agrees with that of either the class Q 
of cycle codes or the class Q* of cocycle codes. It is easily shown (see 
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J6]) that 9g*(R ) = 0 for all R G (0,1). Geelen, Gerards and Whittle j6] 
made the following striking conjecture: 

Conjecture 1.3. Let C be a proper subclass of the binary linear codes 
that is closed under puncturing and shortening. Either 

• Q C C and 9 C = 9g, or 

• 9 C = 0. 

In other words, the presence or absence of the class of cycle codes 
should be all that determines the threshold function for any minor- 
closed class. Proving this conjecture would likely require a combination 
of the matroidal techniques in m and the algebraic and probabilistic 
ideas in this paper. 


2. Preliminaries 


We give some basic definitions in coding theory that, together with 
the definition of threshold function in the introduction, are all that are 
required for this paper; a more comprehensive reference is found in [TO]. 
We also use some standard graph theory terminology from [5] and [7]. 

For integers n > k > 0, a binary linear [n, k\-code is a A;-dimensional 
subspace C of some n-dimensional vector space V over GF(2). We call 
the elements of C codewords. The rate of C is the ratio R, — 

n 


2.1. Cycle codes. This paper is concerned solely with the cycle codes 
of graphs. For a finite graph G = (V, E ), the cycle code of G is the sub¬ 
space of GF(2) S whose elements are exactly the characteristic vectors 
of cycles of G (that is, edge-disjoint unions of circuits of G, or equiv¬ 
alently edge-sets of even subgraphs of G). We write Q for the class of 
all such codes; it is well-known that every cycle code is the cycle code 
of a connected graph. 

If G is connected, then its cycle code C is a binary linear [n, k]- 


code, where n — \E\ and k = \E 


~ \V\ + 1, giving R = 1 - ||[ 


+ 


i 

\E\- 


The ratio j^j is exactly jfppj, where p(G) denotes the average degree 
of G ; we adopt this notation p(G) throughout the paper. The above 
formula implies that a large connected graph G has a cycle code of 
rate R ~ 1 — jfpj]- A simple ‘error-tolerance’ parameter of C is the 
minimum Hamming distance d between two codewords of C; this is 
equal to the girth of G (the length of a shortest circuit of G) - we will 
write d(G) for the girth of a graph G. 


2.2. Maximum-likelihood decoding. Suppose that some codeword 
c of a linear [n, fc]-code C C V is transmitted across a binary symmetric 
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channel with bit-error rate p G (0, |), giving some x G V obtained by 
switching the value of each entry of c independently with probability p. 
Maximum-likelihood, decoding (abbreviated ML-decoding) is the process 
where, given x, we attempt to recover c by choosing the codeword 
c! G C with the highest probability to have been sent, given that x has 
been received. If this choice is ambiguous (that is, if this maximum is 
not unique) or gives an incorrect answer (that is, if d 7 ^ c), then we 
say a decoding error has been made; this occurs with some probability 
depending on p and C but, by linearity, not on the particular codeword 
c. In this particular setting of a constant bit-error probability p < | 
that behaves independently on each bit, ML-decoding is equivalent to 
nearest-neighbour decoding, where d is simply chosen to be the closest 
codeword to x in Hamming distance. We remark that our definition 
of ML-decoding deviates slightly from the standard one, in which a 
decoding error is also avoided with nonzero probability in the case of 
an ambiguous choice. This difference will not affect the asymptotic 
analysis with which we are concerned. 

ML-decoding is hard for general binary codes [3], but an attractive 
property of cycle codes of graphs (and an important motivating factor 
for this paper) is that ML-decoding can be implemented efficiently for 
cycle codes using standard techniques in combinatorial optimization 
(see [12]). This is the case because the probability of a decoding error 
can be understood purely graphically: if C is the cycle code of a graph 
G = (V, E) and codewords of C are transmitted across a channel of 
bit-error rate p G (0, |), then the probability of an ML-decoding error 
is exactly the probability, given a set X C E formed by choosing each 
edge uniformly at random with probability p, that X contains at least 
half of the edges of some circuit of G. Thus, to prove our main theorem, 
we study random subsets of edges of a graph. From this point on, given 
a set E and some p G [0,1], we refer to a random set X C E formed by 
including each element of E independently at random with probability 
p as a p-random subset of E. 

3. Non-backtracking walks 

A non-backtracking walk of length l in a graph G is a walk 
(v 0 , Vi,. . ., Vf) of G so that v i+ i 7 ^ for alii G {1,... , t — 1}. In 
all nontrivial cases, the number of such walks grows roughly exponen¬ 
tially in t\ in this section we estimate the base of this exponent, mostly 
following (j2], Theorem 1). 

Let G — (V, E) be a simple connected graph of minimum degree at 
least 2. Let E = {(u,v) G V 2 : u n} be the 21 A)-element set of arcs 
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of G. Let B = B{G) G {0, \} ExE be the matrix so that -B( u ,t;),(u'y) = 1 
if and only if u' — v and u ^ v' . It is easy to see that 

(1) B is the adjacency matrix of a strongly connected digraph (es¬ 
sentially the ‘line digraph’ of G ), and 

(2) For each integer l > 1, the entry (B e ) e j is the number of non¬ 
backtracking walks of length £+1 in G with first arc (no, fi) — e 
and last arc (ty,ty + i) = /. 

By (JTJ) and the Perron-Frobenius theorem (see [7], section 8.8), there 
is a positive real eigenvalue A* of B and an associated positive real 
eigenvector w*, so that |A*| > |A| for every eigenvalue A of B. Further¬ 
more, by Gelfand’s formula [8] we have A* = lim n _ 5 . 00 ||S n || 1 ^ n , where 
|| B n || denotes the sum of the absolute values of the entries of B n . By 
(J2D, the parameter A* = A* (B(G)) thus governs the growth of non¬ 
backtracking walks in G. 

Note that B e has only nonnegative entries, so \\B e \\ = 1 B'l. Let 
p = p{G) = -|F)| denote the average degree of G. The proof of Theo¬ 
rem 1 of [2] contains the following: 

Lemma 3.1. Let G be a connected graph of minimum degree at least 
2 and let B = B{G). Then 1 T B e l > (np)A e , where 

A = A(G) = JJ(d G (v) - 1 )*?(«)/("**). 

vev 

It follows in turn from this lemma that U^H 1 ^ > A(G), so 
A *(B(G)) > A (G). As observed in [2], the log-convexity of the func¬ 
tion (x — l) x (for x > 1) implies that A(G) > p(G) — 1. For each 
i 6K, let r}(x) = miri(x — |_x_|, |~x~| — x) denote the distance from x to 
the nearest integer. The following lemma, which is proved by slightly 
improving the bound A(G) > p(G) — 1 when p(G) is not an integer, is 
an unilluminating exercise in calculus. 

Lemma 3.2. Let po G M satisfy po > 2 and let G be a connected graph 
with minimum deqree at least 2 and average deqree at least un. Then 
K(B(G))>p 0 -l + ^f. 

Proof. Let n = |IA(G)|, let d \,..., d n be the degrees of the vertices of G, 
and let p — A ^)" =1 d t > p 0 be the average degree of G. Let r/ = p(p); 
note that p > 2 + rj. Dehne g\ (1, oo) —* M by g(x) = xln(x — 1); 
observe that g'{x) = + ln(x — 1) and g"(x) = We have 

ln(A(G)) = W Y^i=\ 9 (di) m , for each i, Taylor’s theorem gives 
g(di ) = g(p) + g'(p){di - p) + ±g"{fi)(di - p) 2 
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for some £* between d% and g o- We now estimate the ‘error’ terms. 
Claim 3.2.1. \g"(£,i)(di — /i) 2 > ^ for each i. 

Proof of claim: First suppose that di = 2. Then g(df) = 0, so 

\ g '\m-p) 2 = -9{g)-g\g)^-g) 

= [P ~ 2 ) (^TT + Md - 1)) - 7 ln(/x - 1) 

= ^- 21 n( h- 1} - 

Note that the above expression is equal to 1.174... > 1 for g = |, 
and is increasing in g for g G (2, oo). If g > | then we therefore have 
|g"(£i)(2 — g) 2 >1. If g < \ then g = 2 + g and g < |, so 

^ - 2 hr (g - 1 ) = _ 2 hi(l + g) 


1+r/ 
> r?(2+r;) 
— 1+V 

„3 


2(7-2 7 +s7) 


= 3(fey( 1 - 2 7) 

> ^ 7 3 , 

where the last inequality uses g < |. Therefore if dj = 2 we have 

ymdi - P) 2 > min(l, ±rf>) = ±g* > 

Suppose that d* > 3. Since ^ is between g and dj, we have £; > 
min (di,g) > min(3 ,g), so & - 2 > g. Therefore #"(&) > > |z• 

Thus, using < max(/i, dj), we have 

1 \ / 7 \ 2 \ 7 (di - g) 2 ^ 7 (di - g) 2 


2ff"(&)(di~g) > 


2 £ 


2 > 


2 max(/i , d t 




It is easy to show, since di G Z, that 


dj-fi 


rnax(//.,r/ ? ) 


> > JL 

— /i+?7 — 2/.t ’ 


4r/'(^)(dj — /i ) 2 > ^2 and the claim follows. 
Using the claim, we have 
1 n 

ln(A(G)) = — ^2g(di) 

n g tr 


so 

□ 


— 51 (7(h) + dV)R - 7) + - g) 2 ) 


n g u 


— ( ng{g) + 55 50 "(&)( d < - gf 


2—1 
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> In (/i - 1 ) + 


= ln(/i - 1 ) + ^- 3 . 


1 

nn 

rf 

8// 3 


nr] 

8]i 2 


So A(G) exp (jj^j > fi - 1 + (fi - 1) > fi - 1 + ^r- 

One easily checks that the function h(y) = y — 1 + is strictly 
increasing on ( 2 , oo); since fi > /i 0 and A*(5(G)) > A(G), it follows 


that A* (5(G)) > /io — 1 + v ^°s , as required. □ 

O/Xq 

For each /j > 2, let denote the class of connected graphs with 
average degree at least /i and minimum degree at least 2. For every 
integer n> fi + 1, let 

A*(/qn) = inf {A* (5(G)): G G $», |1^(G)| = n}, 

noting that this inhmum is hnite since K n G Q,, for all n > /i + 1. 
Dehne A*: [2, oo) —> R by A*(/i) = liminf^oo A*(y^; n). The following 
is immediate from Lemma [3.21 

Lemma 3.3. A*(/x) > fi — 1. If equality holds, then fi G Z. 

Having defined the function A*, we can now state the more technical 
main theorem from which Theorem 11.11 will easily follow. 

Theorem 3.4. If Q is the class of cycle codes of graphs and R G (0,1), 
then 9g(R) < \ ^1 — \Jl- , where A = A* (jzr) ■ 

As mentioned, we believe the above bound is the true value for 9g. 


Conjecture 3.5. The bound in Theorem 3.f holds with equality for all 
R G (0,1). 

By Theorem 11.21 this conjecture holds when R = 1 — ^ for d G Z. 


4. Covering trees 


A locally finite, infinite rooted tree (hereafter just a tree ) is a con¬ 
nected acyclic infinite graph T of hnite maximum degree together with 
a particular vertex r called the root. Adopting some notation of |4] and 
[9], for x G V(r) we write |x| for the distance of x from r, and we write 
x ^ y if x is on the path from r to y. We write x Ay for the join of 
x and y, the vertex of largest distance from r that is on both the path 
from r to x and the path from r to y. 

The trees we are interested in are ‘covering trees’ for hnite graphs. 
Let G = (V, E) be a hnite graph of minimum degree at least 2 and 
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let e = (u, v ) be an arc of G. The covering tree of G rooted at e 
is the tree T = T e (G) where the root is the length-zero walk (u) of 
G, the other vertices are the non-backtracking walks of G with first 
arc e and the children of each walk (u, v, V 2 , ■ ■ ■, vf) of length £ are 
its extensions (u, v, v 2 , ..., ve, t^ + i) to nonbacktracking walks of length 
£ + 1 (ie. where ve+i is adjacent to vg in G and is not equal to 1 ). 
Note that the number of vertices of T e (G) at distance £ from the root is 
the total number of length-^ non-backtracking walks of G with first arc 
e, which is exactly the sum of the entries of the e-column of H(Gp b 

There is a natural homomorphism that associates each walk with 
its final vertex; if G has large girth, this map preserves much of the 
local structure of G. To analyse the ubiquity of cycles in a random 
sample of edges of G, we follow j4] and study a problem of ‘fractional 
percolation’ on covering trees, bounding the probability that, given a 
p-random subset of E(T e (G)), there is a long path starting at r that 
is, in a certain sense, dense with edges in the subset. 

Let T be such a tree, and let a G (0,1). Given A" C -E’(T), we 
say that a finite path (n 0 , tq,..., v n ) of T is a-adapted with respect 
to X if, for each i e {1,... ,n}, the subpath (w 0 ,..., z\) contains at 
least ai edges of X. If ti, t 2 , ■.., is a sequence of positive integers and 
T n = Y^i =1 b is its sequence of partial sums (with T 0 = 0), then we say 
that a path (xq,x\, ... ,x n ) of T is (a, t)-adapted with respect to X if 
for each i e Z >0 for which T i+ \ < n, the path (xT i ,XT i + 1 ,..., xx i+1 - 1 ) is 
a-adapted, and also the path (xT j ,XT j + 1 , • • • ,x n ) is a-adapted, where 
j is minimal so that T J+1 > n. Note that any initial subpath of an 
(a, t)-adapted path is (a, t)-adapted. 

We will be considering p-random subsets X of -E(T). We first esti¬ 
mate, with an argument used in ([1], Proposition 2), the probability 
that a given path is a-adapted with respect to X. Henceforth, we 
denote the ‘relative entropy’ between a and p by 

D(a\\p) = a In + (1 - a) In . 

We remark that [4] defines D(a||p) as the negative of this formula. 

Lemma 4.1. Let 0 < p < a < 1. There exists c > 0 so that, if 
[x 0 , Xi ,..., x n ] is a finite path, and X is a p-random subset of the edges 
of the path, then 

P ([xo, • • • ,x n ] is a-adapted w.r.t. X) > cn~ r °^ 2 exp(—mD(a||p)). 
Proof. We first make a claim that will simplify the estimate. 



THE MLD THRESHOLD FOR CYCLE CODES 


9 


Claim 4.1.1. If |X| > an, then there exists I G {0,... ,n — 1} such 
that the path corresponding to the cyclic ordering [xe, %e+i ,..., x n = 
Xq, Xi, ..., xf\ is a-adapted with respect to X. 

Proof of claim: For each i £ Z n , let t t — 1 — a if the edge XiXi+i is in 
X, and ti = —a otherwise. For 0 < j < j' < n let S(j,f ) = Y2i=j U] 
observe that if S(j, j ') > 0 then the path from Xj to Xj> has an a-fraction 
of its edges in X. In particular, we have 5(0, n) = |X| — an > 0. 
Choose I £ {0,..., n — 1} so that 5(0, £) is minimized. For £ < h < n 
we have S(£,h ) = 5(0, h) — 5(0, £) > 0 and for 1 < h < £ we have 
S(£, n) + 5(0, h ) = 5(0, n) + (5(0, h ) — 5(0, £)) > 0. It follows from the 
observation that £ satisfies the claim. □ 


By the above claim and symmetry, the probability that the path 
[x 0 ,.. - ,x n ] is a-adapted is at least ^P(|X| > an). 

It is straightforward to show using 0 < a < 1 and Stirling’s approx¬ 
imation that all sufficiently large n satisfy 

\an\ \ < (an + l)[anj! < V2wn? [^X) an 
(n — [an])! < V2nn j ) 


so Stirling’s approximation gives ( [Q n nl ) > ^ 3/2 
all large n. All large enough n thus satisfy 

iP(|X|> an) >IP(|X| = fan]) 


a"(l 


a 


il — Ct\ n 


for 


n 


> 

> 


n \[an] 

1 


p\an\ ^ _ p^ n ~\ an ~\ 


P a ( 1 — p) 


1—a \ n 


V2nn 5 / 2 V«"( 1 - «) 1_ 

p 


p 


\ari\—an ^ _ ^an— \ari\ 


\/2iin b / 2 


exp(— nD(a\\p)); 


since the probability of a path being a-adapted is clearly positive for 
all n, some c G ( 0 , ^j=], obtained by taking a minimum over all small 
n, satisfies the lemma. □ 


We say a positive integer sequence t = (U : i > 1) is slow if it is 
nondecreasing and satisfies lim n ^. 00 t n = oo and lim rwoo *£ +1 = 0 . 

The next lemma is the main technical result of this section. It shows 
that, if t is a slow sequence, G is a graph, and a and p are chosen 
so that exp(F>(a||p)) is less than the graph invariant A *(B(G)) of the 
previous section, then there is some arc e$ of G for which a p-random 
subset of FJ(r eo (G)) will give an arbitrarily long (a, t)-adapted path 
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with probability bounded away from zero. The independence of 5 on 
n and G in this lemma is crucial. 

Lemma 4.2. For all 0 < p < a < 1, every slow sequence t, and all 
X > exp(.D(a||p)), there is some 5 = 5(t,X,a,p ) > 0 such that, ifn > 1 
is an integer and G is a connected graph of minimum degree at least 
2 with X*(B(G)) > X, then there is an arc eo of G so that, given a 
p-random subset X C l?(r eo (G)), we have 

P (r eo (G) contains an ( a,t)-adapted path of length n w.r.t. X ) > 5. 

Proof. Let A* = A*(£>((?)). Let t = (U : i > 1) and Tg = Y^i=\ti f° r 
each i > 0 . Let A 0 = exp(D(a||p)) and Ai, A 2 be real numbers so that 
Ao < Ai < A 2 < A. Note that Ao > 1 and A* > A. 

Let n(m) denote the probability that a path of length m is ct-adapted 
with respect to a p-random subset of its edges, and for each i > 0 let 
f(£) = nLi n(ti ) -1 be the reciprocal of the probability that a path of 
length T( is (a, t)-adapted. To determine 5, we first estimate /: 

Claim 4.2.1. There exists M > 0 such that f(£+ 1) < MX^f for all i. 

Proof of claim: Let c > 0 be given by Lemma ITT! for p and a. We have 

i+i 

/(£+1)=n n (^) _i < 

i— 1 


i =1 v 7 

Since Ao < Ai < A 2 and te+i/Tt —> 0 and te —> oo, this expression is at 
most A 2 * for large enough l. The claim follows by taking a maximum 
over all small t. □ 

Set 5 = — A). Let E be the set of arcs of G, let B = B{G ) 

and let w* be the (strictly positive) eigenvector of B for A*, normalised 
to have largest entry 1 . Choose e 0 el such that w*(e 0 ) = 1. We show 
that 5 and eo satisfy the lemma. 

For each e G E, let b e be the standard basis vector in corre¬ 
sponding to e, and let Nh(e o,e) = bl Q B h ~ 1 b e be the number of non- 
backtracking walks of length h in G with first arc eo and last arc e. 


£+i 


t+l ,5/2 

n^—exp ( D(a\\p)^2tj 


i= 1 


3 = 1 


^+1 ,5/2 

WTlV 


i=1 


^+1 + 5/2 / \ \ U 

Ap*n— 


2 — 1 


AS 1 


m ,5/2 / \ \u 

/ An \ 


c \ A 
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Let T = r eo (G) and r be the root of V. Let p: V(r) \ {r} —* E 
be the map assigning each walk to its last arc. Set <f>(r) = 1 and, 
for each vertex x r of T, set <f>(x) = Al ^w*(p(x)). Note that 
0 ((e o )) = wfle o) = 1 and that, for each x r with p[x) = e, the sum 
of (j>{y) over the children y of x is 

A*- (N+1) Y, M e ') : e' G E, B^ = 1) 

= K\ x W e Bw* 

= A* _N w*(e) = <f)(x). 

(In other words, 0 is a unit flow on T.) It follows that for every h > 0 
and all x with |x| < h, we have (0(y) ■ y h x,\y\ — h) = <f>(x). 

For X C E(T), we say that a vertex v of V is (a fl)-reachable with 
respect to A" if the path of V from r to x is (a, f)-adapted with respect 
to A"; let R(X) denote the set of ( a , f)-reachable vertices. Fix £ so that 
T( > n, and dehne a random variable Q = Q(X) by 

Q = f{l) Y ( P( x ) 1 R{X)(x). 

hi = T t 

The <f>{x) sum to 1 over all x with |x| = Tg, so E (Q) = 1. We now 
bound the second moment of Q. 

Claim 4.2.2. E(Q 2 ) < 5" 1 . 

Proof of claim: We have 

EW 2 ) = /M 2 £ <Hx)<Ky)P(x,y £ R(X)). 

\x\=\y\=T e 

For each z G E(T), let k(z) be the maximum integer k > 0 so that 
T k < \z\. There are edge-disjoint paths of lengths ti,t 2 , ■ ■ ■ ,tg and 
tk{x/\y)+ 2 i tk(xAy)+ 3 , ■ ■ ■ flt that all must be «-adapted for both x and y 
to be in R(X) (the first set of paths make up the path from r to x and 
the second set are contained in the path from x A y to y), so 

t l 

p(x,j, 6 fl(x))<n n (tf) JJ u(ti) 

i =1 i=k (x Ay )+2 

= f(k{xAy) + 1 )f(£)~ 2 

< M\z k(xAv) f (£)- 2 

< M\ l * Ayl f(£)~ 2 , 
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where we use the first claim. Using the fact that \x A y\ > 1 whenever 
|x| = \y\ = Tg, we have 


\xAy\ 

'2 


E(Q 2 ) < M E (j>(x)(j)(y) \l 
\A,\y\= T i 

= M ^ H x )Hv) 

l<\z\<T e \x\ = \y\=T e 

xAy=z 

( v 

< M X 2 l x 


l<\z\<T e 


\ 

m y \'^(z) 

i <\A<Tl 

T t. __ 

m E a ^E^ z ) 

i=l \z\=i 


\x\=T t 

x>~z 


) 


If \z\—i> 1, then iy*(e) < 1 gives 

= A l~ 2 i w*{p{z )) 2 < A 2 ~ 2 i wMz))- 

For each e G E, the number of z G V(r) with \z\ = i and p(z) = e is 
lYj(e 0 ,e) = b x Q B l ~ l b e) so since Bw* = Aand iu*(e 0 ) = 1, we have 


E a *-) 2 - 

|z|=i eSA 


A 2-21 


eo 




* 


A‘-‘ < A 1 "* 


Thus E (Q 2 ) < ME"i A-A 1 "' = M(i - A)" 1 = V 1 . □ 


Now by the Cauchy-Schwartz inequality we have 

1 = E(Q) 2 = E (Q • 1 Q>0 ) 2 < E(g 2 )E(lJ >0 ) < r 1 P(g > 0 ), 

so P(g > 0) > S. Therefore V has an (a, t)-adapted path of length 
Tg with respect to X with probability greater than <5. Such a path 
contains an (a, f)-adapted path of length n, giving the result. □ 


5. Graphs 

For a graph G = (V, E) and for p, f3 e [0,1], let f£(G) denote the 
probability, given a p-random subset X C E, that X contains at least 
a /3-fraction of the edges of some circuit of G. Recall that A*(p 0 ) is 
some value not less than po — 1. 
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Theorem 5.1. For all fi 0 > 2 and 0 < p < (5 < 1 satisfying 
exp(D(/3\\p)) < A*(/i 0 ), there exists 5 = 5(p 0 ,p,/3) > 0 such that, if 
G is a connected graph with p(G) > p 0 , then ff?(G) > S. 

Proof. It suffices to show this just for graphs of minimum degree at least 
2 , since deleting a degree-1 vertex from a graph G with p(G) > 2 does 
not change f£ or connectedness, and does not decrease p(G). Suppose 
that the result fails. Then there exists a sequence G\, G 2 , ■ ■ ■, of graphs 
of average degree at least p 0 and minimum degree at least 2 , such that 
lim n ^oo{fp(G n )) = 0. We clearly have f£(G) > p d<yG ) for every graph 
(this is the probability of a p-random subset containing every edge in a 
given shortest cycle), so we may assume by taking a subsequence that 
d{Gi) > i for each i. 

Claim 5.1.1. There is a slow integer sequence t = ( 4 : k > 1) so that 
t\v(G k )\ < Vk for each k. 

Proof of claim: Let ( t : k > 1) be a nondecreasing, divergent integer 
sequence in which the integer [_y/r\ occurs at least \V(G r )\ times for 
each r > 1. (Such a sequence can be chosen to diverge because each 
integer is only required to occur finitely often.) By construction we have 
t\v(G k )\ < W~k\ for eac h k. Furthermore, if £ > 1 and tc+i = d + 1 > 2 
then the integer d has occured at least | W(C?^) | > d 2 times before tg + 1 , 

so t i+ 1 / Yfi=i U <(d+ 1 )/d 3 . It follows that lim ?woo t n+1 / YJLi ^ 
so (tfc: k > 1 ) is slow. □ 

Note that D(x\\p) is increasing in x for x > p. Since exp(D((3\\p )) < 
A*(/io) we can choose a £ (/3, 1 ) and A' so that 

exp(T>(/3||p)) < exp(H(ct||p)) < A' < A*(p 0 )- 

Let k 0 be large enough so that A*(po;'R) > A' for all n > k 0 . Let 
5 = S(t, X',a,p) > 0 be given by Lemma 14.21 We argue that if k is 
sufficiently large so that k > k$ and 2 ^\ +1 < a — (3, then the graph 
G = Gk satisfies fp(G) > 5. This contradicts lirn^oo f^(G n ) = 0. 

Let G = Gk for such a k, and let T = r e (G) be the covering tree of G 
with respect to the arc e = (r, s) given by Lemma [4.21 Let 7 r: V^r) — 
V(G) assign each path to its final vertex. Since |V r (G)| > k > k 0 , we 
have A *(B(G)) > A*(/i 0 ; k) > A' by the choice of k 0 . 

We now relate fp(G) to the probability that a p-random subset of 
E(T) gives a long (a, f)-adapted path. For each set Z C V(G), let 
G(Z) denote the subgraph of G induced by Z. 

Recalling notation from the proof of Lemma [4.21 for X C E(G) we 
say a vertex v of G is reachable with respect to X if v — r, or there is 
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an (a, t)-adapted path of G (with respect to X ) having first arc e and 
last vertex v. We write R(X ) for the set of all such vertices. Similarly, 
for Y C E(T), we say a vertex v of T is reachable with respect to Y if 
there is an (a, f)-adapted path of T (with respect to Y) from the root 
to v. Let R(Y) denote the set of all such vertices. Note, for any X and 
Y, that each of the sets R(X) and 7 r(R(Y)) either is equal to {r}, or 
induces a connected subgraph of G containing r and s. 

Suppose that X is a 71 -random subset of E(G) and Y is a 71 -random 
subset of £(r). Let C G denote the event that G(R(X)) contains a 
circuit, and Cr denote the event that G(tt(R(Y))) contains a circuit. 

Claim 5.1.2. P(C G ) = P(C r ). 

Proof of claim: Let Z' denote the family of subsets of V(G) that induce 
an acyclic connected subgraph of G containing r and s, and let Z = 
Z' U {{r}}. The event C G fails to hold exactly when R(X) G Z , so 

1 - P(Co) = ]T P(R(X) = Z). 
z&z 

Similarly, we have 

1 - P(Cr) = £ PWfl(D) = z). 

z&z 

If Z = {r}, then clearly P(R(X) = Z) = P(tt (R(Y)) = Z) = 1 - p. 
Suppose that Z G Z'. By acyclicity of G(Z), there is a unique subtree 
T z of T that contains the root of T and satisfies 7 r(P(r^)) = Z, and 
moreover G(Z) and T z are isomorphic finite trees. Now G(Z) and T z 
have the same number of edges, and the number of edges of G with 
exactly one end in Z \ {r} is equal to the number of edges of Y with 
exactly one end in V(r^), so 

P(fl(V) = Z) = P(R(V) = V(r z » = P(w (R(Y)) = Z). 

The claim now follows from the two summations above. □ 

Claim 5.1.3. P(C r ) > 5. 

Proof of claim: By Lemma 14.21 the tree T contains, with probability 
at least 5, a length-|V(G)| path [vi, v 2 , • • •] that is (a, t)-adapted with 
respect to Y. For any such path, there must be some i < j so that 
7T (vf) = 7 r(vj)] now ( 77 ( 7 ^), 7r(nj + i),..., 7r(nj)} is the vertex set of a 
closed non-backtracking walk of G(n(R(Y))), which must contain a 
circuit. This implies the claim. □ 

Claim 5.1.4. f£(G) > P(C G ). 
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Proof of claim: Suppose that X C E satisfies Cq] he. G(R(X)) con¬ 
tains a circuit C. It suffices to show that A" contains a /3-fraction of 
the edges of some circuit of G. Let V{C) = [xq,Xi, ... ,x m ], where x 0 
is the end of a shortest (a, f)-adapted path P 0 from r to V(C). If there 
is some i G {1,... ,m} such that there exists in G an (a, f)-adapted 
path Pi from r to Xi not containing Xj_i and an (a, t)-adapted path 
Pi -1 from r to not containing Xi, then E{Pf) U E(Pi-i) U { Xi-\Xi } 
contains a circuit C' of G. Moreover, this circuit is the disjoint union 
of the edge Xi-iX i: a set of subpaths that are a-adapted with respect 
to X, and at most two extra subpaths each of length at most t\v(G)\ 
(these two subpaths are ‘partial’ subpaths arising because the last in¬ 
tersection point of Pi -1 and Pi need not cleanly divide these paths into 
a union of a-dense subpaths), so \X C\E{G')\ > a\E(C')\ — 2t\v(G)\ ~ 1- 
Now G = Gk, so \E(C')\ > d(G) > k and t\v(G)\ < Vk, giving 


|ATlE(C')| > _ 2*|VfG)|+l 

\E(C')\ - tt \E(C')\ 


> a- ^$±1 

— k 


>P, 


so X contains a /3-fraction of the edges of C'. 

If no such i exists, then an easy inductive argument implies for each 
j > 1 that every (a, t)-adapted path from r to Xj passes through Xj- 1 , 
so E(P 0 )LiE(C) — {xoXm} is the edge set of an ( a , f)-adapted path from 
r to x m . By a similar argument to the above, we have | E(C) D X\ > 
a\E{C) \ — 2t\v{G)\ ~ 1) an d fi lus ^ contains a /3-fraction of the edges 
of C, giving the claim. □ 

The last three claims give fp(G) > S, implying the theorem. □ 


6. The Threshold 

We now prove Theorems 13.41 and 11.11 Recall that, if C is the cycle 
code of a graph G , then the probability of a maximum-likelihood de¬ 
coding error in C over a channel of bit-error rate p6 (0, |) is exactly 

the parameter f p (G) of the previous section. We use this fact to 
derive Theorem 13.41 (restated here) from Theorem 15.11 

Theorem 6.1. If R G (0,1) and Q is the class of cycle codes of graphs, 
then 0g(R) < \ ^1 — ^l — jj'j , where A = A*(j-^). 

Proof. Fix R G (0, 1), let /i = -j— ^ and let 9 = | ^1 — yj 1 — , where 

A = A*(/r). Note that exp(Z3(A||6 1 )) = X > p — 1 > 1 by Lemma [3731 It 
is enough to show that for all p G (9 , |) there is some £ > 0 such that 
the probability of an error in maximum-likelihood decoding of a cycle 
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code of rate at least R , over a binary symmetric channel with bit-error 
rate p, is at least e. 

Let p G (0, |). Since p > 6 we have exp(Zl(|||p)) < A; let A 0 G 
(exp(lA(|||p)), A) and let p 0 = \ 0 + 1. Let 5 = 5(p 0j p, |) be given by 
Theorem 15.11 and set £ = min(5,p & ), where b = ■ 

Let C be a cycle code of rate R(C) > R and let G be a connected 
graph whose cycle code is C. Note, since R > 0, that G contains a 
circuit, so f^ 2 (G) > p\ E ^>\. If p(G) > /i 0 then f^ 2 (G) > S > e by 
Theorem 15.11 Otherwise 

1 — - — R< R(C ) = 1-+ jp^TT < 1 - — + TWr\\-, 

n — \ > fi(G) \E(G)\ po |S(G)p 

so |£'(G')| < = b and thus fl^ 2 (G) > p b > e, as required. □ 

Finally, we restate and prove Theorem 11.11 

Theorem 6.2. If Q is the class of cycle codes of graphs and R G (0,1), 
then 0g(R) < ■ V equality holds, then R — 1 — | for some d G Z. 

Proof. Let /i = -^ and A = A*(/x). By Lemma [3731 we have A > p — 1 
with equality if and only if p G Z. Theorem 16.11 thus gives 0g(R) < 

— ^ 1 + , with equality only if p G Z: that is, if and only if 

R = 1 — ^ for some d G Z. The result now follows from the definition 
of /j and a computation. □ 
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